Network application apparatus

ABSTRACT

An apparatus and method to distribute applications and services in and throughout a network. The apparatus includes the functionality of a switch with the ability to apply applications and services to received data according to respective subscriber profiles. Front-end processors, or Network Processor Modules (NPMs), receive and recognize data flows from subscribers, extract profile information for the respective subscribers, utilize flow scheduling techniques to forward the data to applications processors, or Flow Processor Modules (FPMs). The FPMs utilize resident applications to process data received from the NPMs. A Control Processor Module (CPM) facilitates applications processing and maintains connections to the NPMs, FPMs, local and remote storage devices, and a Management Server (MS) module that can monitor the health and maintenance of the various modules. In an embodiment, the MS can download and otherwise control applications on the FPMs that execute the Linux operating system to provide an open architecture for downloading, executing, modifying, and otherwise managing applications.

CLAIM OF PRIORITY

This application claims priority to U.S. patent application Ser. No.09/790,434, which was filed Feb. 21, 2001, for a “Network ApplicationApparatus”, and which in turn claimed the benefit of U.S. ProvisionalApplication Ser. No. 60/235,281, entitled “Optical Application SwitchArchitecture with Load Balancing Method”, and filed on Sep. 25, 2000,naming Mike Ackerman, Stephen Justus, Throop Wilder, Kurt Reiss, RichCollins, Derek Keefe, Bill Terrell, Joe Kroll, Eugene Korsunky, A. J.Beaverson, Avikudy Srikanth, Luc Parisean, Vitaly Dvorkian, Hung Trinh,and Sherman Dmirty as inventors, the contents of which are hereinincorporated by reference.

BACKGROUND OF THE INVENTION

(1) Field of the Invention

The present invention relates generally to network devices, and moreparticularly to improved devices and methods for delivering services andapplications to network users.

(2) Description of the Prior Art

Increasing numbers of businesses, services, and other providers areexpanding their offerings on the internet. The basic structure forproviding network services, however, is constrained with data transportdependencies. Unfortunately, a given service is often provided from asingle network location that is deemed the central location for theservice. This location may be identified by a destination internetprotocol (IP) address that corresponds to a server that is capable ofreceiving and processing the request. Prior art systems attempt to easethe demand for a given service by providing a multiplicity of servers atthe destination IP address, wherein the servers are managed by acontent-aware flow switch. The content-aware flow switch interceptsrequests for the application or service and preferably initiates a flowwith a server that maintains a comparatively low processing load.Although the prior art systems may attempt to increase the computationalpower at the particular destination IP address by distributing therequests at the IP address, data transport dependencies remain inherentin the network structure. The content-aware flow switch is thereforelimited by the rate at which requests arrive.

There is currently not a scalable system or method to alleviate the datatransport dependencies characteristic of large computer networks such asthe internet.

What is needed is a system and method for delivering applications andservices to computer network users that is scalable to increased networkdemands for applications and services, and thereby mitigates datatransport dependencies typical of the present internet architecture.

SUMMARY OF THE INVENTION

The methods and systems of this invention provide a scalablearchitecture and method to facilitate the allocation of network servicesand applications by distributing the services and applicationsthroughout a network such as the internet. In an embodiment, the methodsand systems can be implemented using a switch architecture that caninclude applications processors that can execute applications andservices according to subscriber profiles. In one embodiment, theapplications processors utilize the LINUX operating system to provide anopen architecture for downloading, modifying, and otherwise managingapplications. The switch architecture can also include a front-endprocessor that interfaces to the network and the application processors,recognizes data flows from subscribers, and distributes the data flowsfrom the network to the applications processors for applicationsprocessing according to subscriber profiles. In an embodiment, thefront-end processors can recognize data flows from non-subscribers, andswitch such data flows to an appropriate destination in accordance withstandard network switches. In one embodiment, the front-end processorsinclude flow schedules for distributing subscriber flows amongst andbetween several applications processors based on existing flowprocessing requirements, including for example, policy.

In an embodiment, the applications processors and front-end processorscan be connected to a control processor that can further access localand remote storage devices that include subscriber profile informationand applications data that can be transferred to the front-end orapplications processors. The control processor can further aggregatehealth and maintenance information from the applications and front-endprocessors, and provide a communications path for distributing health,maintenance, and/or control information between a management processorand the front-end and applications processors.

In an embodiment, the methods and systems disclosed herein can includethe functionality of a switch that can be located at the front-end of anetwork of servers, while in another embodiment, the network apparatusmay be between routers that connect networks.

In one embodiment, the front-end processors can be Network ProcessorModules (NPMs), while the at least one applications processor can beFlow Processor Modules (FPMs). The control processor can include aControl Processor Module (CPM). In this embodiment, the NPMs caninterface to a communications system network such as the internet,receive and classify flows, and distribute flows to the FPMs accordingto a flow schedule that can be based upon FPM utilization. The at leastone FPM can host applications and network services that process datafrom individual flows using one or more processors resident on the FPMs.The CPM can coordinate the different components of the switch, includingthe NPMs and FPMs, allow management access to the switch, and supportaccess to local storage devices. Local storage devices can store images,configuration files, and databases that may be utilized whenapplications execute on the FPMs.

In an embodiment, the methods and systems of the invention can alsoallow the CPM to access a remote storage device that can storeapplications and databases. An interface to at least one managementserver (MS) module can receive and aggregate health and statusinformation from the switch modules (e.g., NPMs, FPMs, CPMs) through theCPMs. In one embodiment, the MS module can reside on a separate hostmachine. In another embodiment, the management server modulefunctionality can be incorporated in a processor resident on a CPM.

In one embodiment, an internal switched Ethernet control bus connectsthe internal components of the switch and facilitates management andcontrol operations. The internal switched Ethernet control bus can beseparate from a switched data path that can be used for internal packetforwarding.

In an embodiment of the invention, the NPMs, the CPMs, the FPMs, and theinterconnections between the NPMs, CPMs, and FPMs, can be implementedwith selected redundancy to enhance the fault tolerant operations andhence system reliability. For example, in one embodiment wherein twoNPMs, ten FPMs, and two CPMs can be implemented, the two NPMs canoperate in redundant or complementary configurations. Additionally, thetwo CPMs can operate in a redundant configuration with the first CPMoperational and the second CPM serving as a backup. The NPMs and CPMscan be controlled via the Management Server module that can determinewhether a particular NPM or CPM may be malfunctioning, etc. In this sameexample, up to two FPMs can be identified as reserve FPMs to assist inensuring that, in case of an FPM failure, eight FPMs can function at agiven time, although those with ordinary skill in the art will recognizethat such an example is provided for illustration, and the number ofreserve or functioning FPMs can vary depending upon system requirements,etc. The illustrated FPMs can be configured to host one or moreapplications, and some applications can be resident on multiple FPMs toallow efficient servicing for more heavily demanded applications. Dataflows entering the switch in this configuration can be received from anoriginator, processed by a NPM and returned to the originator, processedby a NPM and forwarded to a destination, forwarded by a NPM to a flowprocessor and returned via the NPM to the originator, or forwarded by aNPM to a flow processor and forwarded by the NPM to a destination. In anembodiment wherein two or more NPMs are configured for complementaryoperation, a flow received by a first NPM may be processed, forwarded toa second NPM, and forwarded by the second NPM to a destination. Inanother embodiment, the first NPM can receive a flow and immediatelyforward the flow to the second NPM for processing and forwarding to adestination. In complementary NPM embodiments, FPM processing can alsobe included within the described data paths.

In an embodiment, the well-known Linux operating system can be installedon the FPM and CPM processors, thereby providing an open architecturethat allows installation and modification of, for example, applicationsresiding on the FPMs. In an embodiment, the NPMs can execute thewell-known Vxworks operating system on a MIPS processor and a smallexecutable on a network processor.

Other objects and advantages of the invention will become obvioushereinafter in the specification and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete understanding of the invention and many of the attendantadvantages thereto will be readily appreciated as the same becomesbetter understood by reference to the following detailed descriptionwhen considered in conjunction with the accompanying drawings, whereinlike reference numerals refer to like parts and wherein:

FIG. 1A shows four example modes of operation for the network apparatusdisclosed herein;

FIG. 1B shows an illustration of an edge-based firewall embodiment forthe systems and methods disclosed herein;

FIG. 2 is a block diagram of an apparatus according to the invention;

FIG. 3A is a block diagram of the basic data flow through the apparatusof FIG. 2;

FIG. 3B is a block diagram of a storage area network embodiment for theapparatus of FIG. 2;

FIG. 4 is a diagram of a redundant architecture for a system accordingto FIG. 2;

FIG. 5 is a schematic of a Network Processor Module (NPM) for thesystems of FIGS. 2 and 4;

FIGS. 6A, 6B, 6C, 6D, 6E, and 6F detail embodiments of a networkinterface for the NPM of FIG. 5;

FIG. 7 illustrates a crossover on the backplane within the illustratedNPM of FIG. 5;

FIG. 8 is an architectural block diagram of a Flow Processor Module(FPM) for the embodiments of FIGS. 2 and 4; and,

FIG. 9 is a block diagram of an illustrative Control Processor Module(CPM) architecture according to the representative systems of FIGS. 2and 4.

DESCRIPTION OF ILLUSTRATED EMBODIMENTS

To provide an overall understanding of the invention, certainillustrative embodiments will now be described; however, it will beunderstood by one of ordinary skill in the art that the systems andmethods described herein can be adapted and modified to provide systemsand methods for other suitable applications and that other additions andmodifications can be made to the invention without departing from thescope hereof.

For the purposes of the disclosure herein, an application can beunderstood to be a data processing element that can be implemented inhardware, software, or a combination thereof, wherein the dataprocessing element can include a number of states that can be zero orany positive integer.

For the purposes of the methods and systems described herein, aprocessor can be understood to be any element or component that iscapable of executing instructions, including but not limited to aCentral Processing Unit (CPU).

The invention disclosed herein includes systems and methods related to anetwork apparatus that can be connected in and throughout a network,such as the internet, to make available applications and servicesthroughout the network, to data flows from subscriber users. Althoughthe apparatus can perform the functions normally attributed to a switchas understood by one of ordinary skill in the art, and similarly, theapparatus can be connected in and throughout the network as a switch asunderstood by one of ordinary skill in the art, the apparatusadditionally allows the distribution of applications throughout thenetwork by providing technical intelligence to recognize data flowsreceived at the switch, recall a profile based on the data flow, apply apolicy to the data flow, and cause the data flow to be processed byapplications or services according to the profile and/or policy, beforeforwarding the data flow to a next destination in accordance with switchoperations as presently understood by one of ordinary skill in the art.In an embodiment, the next destination may be a network address or aanother device otherwise connected to the network apparatus. Byincreasing the availability of services by distributing the servicesthroughout the network, scalability issues related to alternatesolutions to satisfy increased demand for applications and services, areaddressed.

FIG. 1A displays four exemplary modes and corresponding illustrativeexamples of operation for the network apparatus or device presentedherein, wherein such modes are provided for illustration and notlimitation. The first mode shown in FIG. 1A can be utilized for, as anexample, a firewall application, wherein data flows can be received bythe network apparatus and processed in what can otherwise be known as a“pass or drop” scenario. In such applications, the network apparatus canaccept data flows from one interface and either pass the flow to adestination using a second interface according to permissions providedby the firewall, or the data flow may be dropped (i.e., not forwarded tothe destination). In the second scenario of FIG. 1A, labeled “modify,source, and send,” a data flow received by the network apparatus can bereceived by a first interface, modified, and forwarded via a secondinterface to a destination. An example embodiment of the second scenarioincludes content insertion. In the third scenario of FIG. 1A, thenetwork apparatus can function as a proxy wherein data flows can bereceived, processed, and returned at a first data interface, andsimilarly, data flows received from a second data interface can beprocessed and returned via the second interface, wherein the respectivedata flows can be dependent or otherwise related. Sample embodiments ofthe third scenario of FIG. 1A include transaction services and protocoltranslation. In the fourth sample embodiment of FIG. 1A, the networkapparatus can be utilized for applications including, for example, VoIPconferencing, content insertion, and application caching, wherein dataflows can be received at a first interface, processed, and returned viathe first interface.

FIG. 1B provides another illustration of the network apparatus anddemonstrates a data flow for an edge-based firewall embodiment 200incorporating the network apparatus according to the methods and systemsdisclosed herein. In the illustration, data flows in the form ofinternet requests from a subscriber to Internet Service Provider (ISP) A202 and a subscriber to ISP B 204 are input to a Digital Subscriber LineAccess Multiplexer (DSLAM) 206 and thereafter forwarded to anAsynchronous Transfer Mode (ATM) switch 208 within an ISP A-relatedSuper-POP, that aggregates the flows and forwards the flows to a router210. The router 210 directs the data flow traffic to the network deviceor apparatus 12 that recognizes the flows from the respective ISPsubscribers 202, 204 and applies respective firewall policies. In theillustrated embodiment, ISPs A and B are subscribers to the networkapparatus 12 and in accordance therewith, provide profiles andapplications/services in accordance with such profiles for distributionand processing by the apparatus in conformance with the profiles. In theillustrated embodiment, applications in addition to the respectivefirewall policies, for example, can be applied to the respective dataflows. After the respective processing is performed by the networkapparatus 12, in the illustrated embodiment, the data flow from the ISPA subscriber 202 is forwarded to the internet 212 with the applicationsapplied to the data, while the data flow from the ISP B subscriber 204is forwarded to ISP B 214 with the policy applied to the data.

The network apparatus 12 can also recognize data as not otherwisebelonging to a subscriber and therefore not eligible for applicationsprocessing, wherein such data can be switched to a destination inaccordance with a switch presently known to one of ordinary skill in theart. Those with ordinary skill in the art will also recognize thatalthough this disclosure presents the apparatus connected within thenetwork known as the internet, the internet application is presented forillustration and not limitation. In an embodiment wherein the apparatusis used with a communications system such as the internet, the apparatuscan be connected at the front-end of a server network, or alternately,between routers that connect networks, although the apparatus disclosedherein is not limited to such embodiments.

FIG. 2 shows another illustrative block diagram 10 of the networkapparatus 12 that can host applications and connect into and throughoutthe infrastructure of a network such as the internet, therebydistributing the hosted applications and/or services accordinglythroughout the network. Those with ordinary skill in the art willrecognize that the FIG. 2 illustration is intended to facilitate thedisclosure of the invention and is not intended as a limitation of theinvention. As indicated by FIG. 2, the illustrated apparatus 12 includestwo Network Processor Module (NPMs) 14 that facilitate the flow ofnetwork into and out of the network apparatus 12 by independentlymaintaining, in the illustrated embodiment, two Gigabit Ethernetconnections. Those with ordinary skill with recognize that GigabitEthernet connections are merely one high-speed data link, and other suchdata links can be substituted without departing from the scope of theinvention. In an embodiment where the apparatus 12 is inserted in-lineon a trunk connecting subscribers to the internet core, for example, theGigabit Ethernet connections can optionally interface to a subscribernetwork 16 and the internet core 18. Those with ordinary skill in theart will recognize that in another embodiment, a single NPM can beutilized, and the two Gigabit Ethernet connections can connect to twodifferent networks, for example. Additionally, those with skill in theart will recognize that for the illustrated system, the apparatus 12 canutilize a single bi-directional interface to connect to the subscribernetwork 16 and internet core 18. The FIG. 2 NPMs 14 connect via anEthernet through a cross-connect 20 to at least one Flow ProcessorModules (FPMs) 22 that apply applications and services to data flows,and to at least one Control Processor Module (CPM) 24 that can processdata flow requests and collect health and maintenance information fromthe NPMs 14 and FPMs 22. Each illustrated NPM 14, FPM 22, and CPM 24also connect to a high-speed switching fabric that interconnects allmodules and allows internal packet forwarding of data flows between theNPM 14, FPM 22, and CPM 24 modules. The CPM 24 similarly independentlyconnects to the FPMs 22 and NPMs 14 in the representative embodiment bya 100Base-T Ethernet Control Bus 26 that can be dual redundant internalswitched 100 Mbyte/second Ethernet control planes. The illustrated CPMs24 also connect to a Management Server (MS) module 28 by a 100Base-TEthernet, to a local memory device 30, and to a Data Center 32 through aGigabit Ethernet connection. The MS module 28 allows for datacollection, application loading, and application deleting from the FPMs22, while the local memory device 30 and Data Center 32 can store datarelated to applications or profile information. In the illustratedsystem of FIG. 2, there are two NPMs 14, at least two CPMs 24, and tenFPMs 22, although such a system is merely illustrative, and those withordinary skill in the art will recognize that fewer or greater numbersof these components may be utilized without departing from the scope ofthe invention. In the illustrated system of FIG. 2, the two NPMs canoperate in complementary or redundant configurations, while the two CPMscan be configured for redundancy.

As indicated, using an architecture according to the principlesillustrated, the apparatus 12 may be placed within the normal scheme ofa network such as the internet, wherein the apparatus 12 may be located,for example, at the front-end of a server network, or alternately andadditionally, between routers that connect networks. Using firmwareand/or software configured for the apparatus modules, the apparatus 12can be configured to provide applications to subscribers, wherein theapplications can include virus detection, intrusion detection,firewalls, content filtering, privacy protection, and policy-basedbrowsing, although these applications are merely an illustration and arenot intended as a limitation of the invention herein. In one embodiment,the NPMs 14 can receive data packets or flows and process such packetsentirely before forwarding the packets to the appropriate destination.In the same embodiment, the NPMs 14 can receive and forward the packetsto an appropriate destination. Also in the same embodiment, the NPMs 14can recognize data packets that require processing that can be performedby applications residing on the FPMs 22; and in these instances, theNPMs 14 can perform flow scheduling to determine which FPM 22 canappropriately and most efficiently process the data, wherein the datapackets or flow can then be forwarded to the selected FPM 22 forprocessing. In an embodiment, not all FPMs 22 can process all types ofprocessing requests or data packets. Additionally, to process a datarequest, in some instances, a FPM 22 can require information from thelocal memory device 30 or the remote memory device 32, wherein the NPM14 can direct the retrieval of storage data through the CPM 24 andthereafter forward the storage data to the FPM 22. An FPM 22 canthereafter transfer processed data to the NPM 14 for forwarding to anappropriate destination. With the apparatus 12 architecture such as thatprovided by FIGS. 1 and 3, application service providers can moreefficiently provide services to subscribers by integrating and makingavailable services throughout a network such as the internet, ratherthan at a single location that is often designated as a single IPaddress.

FIG. 3A shows a schematic of data flow through the apparatus 12 ofFIG. 1. As FIG. 3A indicates, NPMs 14 may provide an interface betweenthe subscriber interface and the network core. The FIG. 3A NPM 14 canreceive data from a first interface 14 a, and depending on the datarequest, can process the data and transmit the processed data usingeither the first interface 14 a or the second interface 14 b.Alternately, the NPM 14 can forward the received data to a FPM 22 thatcan thereafter return the processed data to the NPM 14 for transmissionor forwarding using either the first interface 14 a or the secondinterface 14 b. Similarly, the NPM 14 can receive data from the secondinterface 14 b, process the data, and transmit the processed data usingeither the first interface 14 a or the second interface 14 b.Additionally, data received by the NPM 14 through the second interface14 b can be forwarded to the FPMs 22 for processing, wherein the FPMs 22can return the processed data to the NPM 14 for transmission througheither the first interface 14 a or the second interface 14 b. In anotherexample, data received by the NPM 14 can be processed by multiple FPMs22, wherein the data can be forwarded to the multiple FPMs 22 throughthe NPM 14, and returned to the NPM 14 for forwarding to a destination.

In an embodiment wherein two NPMs are configured for complementaryoperation, data received at a first NPM can be processed by the firstNPM, transmitted to a second NPM, and forwarded by the second NPM to adestination. Alternately, data received at the first NPM can beforwarded to the second NPM, processed, and forwarded to a destinationaccordingly. In yet other scenarios, data received at either of the twoNPMs can be forwarded to any of the FPMs 22, processed, and returned toeither of the NPMs for forwarding to a destination. Those with ordinaryskill in the art will recognize that the examples of data movement andprocessing entering, within, and exiting the apparatus 10 are merely forillustration and not limitation, and references to the first NPM andsecond NPM in the complementary embodiment can be exchanged, forexample, without departing from the scope of the invention.

FIG. 3B shows the system of FIGS. 2 and 3A configured to operate inaccordance with a Storage Area Network (SAN) as is commonly known in theart. In the configuration of FIG. 3B, the NPM 14 and FPM 22 integrationas indicated in FIG. 3A is preserved, however, the NPM 14 and FPM 22also maintain interfaces to one or more storage devices 23 that can beany storage device commonly known in the art, including but not limitedto RAM, ROM, diskettes, disk drives, ZIP drives, RAID systems,holographic storage, etc., and such examples are provided forillustration and not limitation. As FIG. 3B indicates, data can bereceived at the NPM 14 and transferred directly to the storage devices23; or, data received by the NPM 14 can be forwarded to one or more FPMs22 before being forwarded by the FPMs 22 to the storage devices 23,wherein the FPMs 22 can perform processing on the data before forwardingthe data to storage 23. Similarly, in the FIG. 3B configuration, datacan be retrieved from storage 23 by either the NPM 14 or FPMs 22. In theFIG. 3B configuration, the NPM 14 and FPMs 22 maintain externalinterfaces that can accommodate data input and output.

FIG. 4 illustrates an alternate representation of the FIG. 2 system thatimplements a dual redundant architecture. In the FIG. 4 embodiment of aredundant architecture, there are two NPMs 14 a, 14 b, two CPMs 24 a, 24b, and ten FPMs 22 a-22 n that reside in a fourteen rack chassis. In theFIG. 4 system, eight FPMs 22 are provided for typical apparatus 12operation, with two FPMs 22 provided as alternates in the case offailure of up to two of the operational eight FPMs 22. As FIG. 4indicates, redundant internal switched 100 Mbyte/second (100Base-T)Ethernet control planes 170 a, 170 b, provide connections between eachof the NPMs 14 a, 14 b, CPMs 24 a, 24 b, and FPMs 22 a-22 n. Theillustrated system also includes dual fabric links 172 a, 172 b, whereineach FPM 22 a-22 n and CPM 24 a, 24 b connect to each fabric link 172 a,172 b, while the first NPM 14 a connects to the first fabric link 172 b,and the second NPM 14 b connects to the second fabric link 172 b toallow each NPM 14 a, 14 b to operate independently of the other.

Additionally, as indicated in FIG. 4, the FIG. 4 NPMs 14 a, 14 bmaintain two Gigabit Ethernet connections to the network, wherein one ofthe connections can be to a subscriber including a subscriber network,etc., while the other connection can be to the internet core.Alternately, the illustrated CPMs 24 a, 24 b maintain a Gigabit Ethernetconnection to communicate with a remote storage device illustrated asthe data center 32 of FIG. 2.

FIG. 5 shows a schematic block diagram of an illustrative NPM 14according to FIGS. 2 and 4. As indicated in FIGS. 2 and 4, according tothe invention, the apparatus or switch 12 can include one or more NPMs14, and when more than one NPM 14 is utilized, the NPMs 14 may beconfigured for redundant or complementary operation.

A NPM 14 can include a modular and optional subsystem illustrated inFIG. 5 as a network interface subsystem 40. This subsystem 40 physicallyconnects the switch 12 and a network, thereby providing a data flowbetween the switch 12 and the network. The NPM 14 also includes aNetwork Processor 42 that connects to the network interface subsystem40. The Network Processor 42 can be, for example, an IQ2000 NetworkProcessor, and those with ordinary skill in the art will recognize thisexample as an illustration and not a limitation, wherein any like deviceperforming the functions as described herein may be similarlysubstituted. Additionally, a second processor can be co-located withinthe NPM architecture without departing from the scope of the invention.In the case of the illustrated IQ2000 Network Processor 42, the networkinterface system 40 can connect to ports A and B of the NetworkProcessor 42 using a FOCUS bus, wherein such ports shall hereinafter bereferred to as FOCUS ports A and B, and wherein two remaining FOCUSports labeled C and D are available on the Network Processor 42.

The network interface subsystem 40 can be a changeable component of theNPM architecture, wherein the different options can be different PrintedCircuit Board (PCB) designs or pluggable option boards, however, thosewith ordinary skill in the art will recognize that such methods ofimplementing the network interface subsystem 40 are merely illustrativeand the invention herein is not limited to such techniques.

For example, FIGS. 6A through 6F provide various illustrative networkinterface subsystem 40 options for the FIG. 5 NPM 14. Referring to FIG.6A, the two Gigabit Ethernet interfaces 50, 52 to the FIG. 5 NetworkProcessor 42 are supported through the Network Processor's 42 twoembedded Gigabit Ethernet Media Access Control devices (MACs). In theFIG. 6A embodiment of a network interface subsystem 40, the onlyexternal devices necessary for Gigabit Ethernet operation include theGigabit Ethernet physical layer device (PHY) 54 a, 54 b and opticalinterfaces 56 a, 56 b. In the illustrated embodiment, a first opticalinterface 56 a can couple to a subscriber's network equipment, while asecond optical interface 56 b can couple to the internet core.

Referring now to FIG. 6B, there is an illustrative configuration for theFIG. 5 NPM 14 wherein FOCUS ports A and B can support up to eight 10/100Ethernet ports through an external octal 10/100 MAC 60 a, 60 b. In FIG.6B, the two external eight port 10/100 MACs 60 a, 60 b couple to theFOCUS ports and to two external eight port 10/100 PHY devices 62 a, 62b. The PHY devices respectively couple to eight RJ-45 connections 64 a,64 b. In the FIG. 6B configuration, one set of eight RJ-45 ports 64 acan be dedicated to the subscriber's network, while the remaining eightRJ-45 ports 64 b can couple to the internet core. In one embodiment, thearchitecture of FIG. 6B can allow software or firmware to configure theports as independent data streams such that data received on asubscriber's port can be returned on a internet port.

Referring now to FIG. 6C, there is a network interface subsystem 40configuration for the illustrated NPM 14 of FIG. 5, wherein the switch12 can receive ATM cells with the cooperation of a Segmentation andReassembly device (SAR) 70 a, 70 b connected to the A and B FOCUS ports.In the configuration of FIG. 6C wherein OC-3c ATM operation isillustrated, four optical interfaces 72 a provide the subscriberinterface, while four optical interfaces 72 b provide the internet coreinterface. The respective subscriber and internet optical interfaces 72a, 72 b couple to a four port framer 76 a, 76 b that provides input to aTransmission SAR 70 a (TX, “to” the switch 12), or receives output froma Receiver SAR 70 b (RX, “from” the switch 12). In the illustratedconfiguration, the SARs 70 a, 70 b utilize a 32-bit SRAM 77 and a 64-bitSDRAM 78, although such an embodiment is merely for illustration. In theillustrated system of FIG. 6C, the SAR UTOPIA ports interface to theFOCUS A and B ports through a Field Programmable Gate Array (FPGA) 79.Those with ordinary skill in the art will recognize that the networkinterface subsystem of FIG. 6C, as with the other diagrams providedherein, is merely provided for illustration and not intended to limitthe scope of the invention; therefore, components may be otherwisesubstituted to perform the same functionality, wherein for example, asingle SAR capable of transmission and receiving may be substituted forthe two SARs 70 a, 70 b depicted in the illustration of FIG. 6C.

Referring now to FIG. 6D, there is a network interface subsystem 40configuration for the illustrated NPM 14 of FIG. 4, wherein OC-12c ATMoperation may be enabled. In the illustrated system, one OC-12c opticalinterface 80 a can couple to the subscribers, while a second OC-12coptical interface 80 b can couple to the internet core. In contrast toFIG. 6C, FIG. 5D illustrates only a two port framer 82 that thereafterinterfaces to the TX and RX SARs 84 a, 84 b, FPGA 86, and the respectiveFOCUS ports of the Network Processor 42.

Referring now to FIG. 6E, there is an OC-3C Packet Over SONET (POS)configuration for the network interface subsystem 40 of FIG. 5. In theillustrated configuration of FIG. 6E, four optical interfaces 90 a caninterface to the subscriber, while four optical interfaces 90 b can bededicated to the internet core. The optical interfaces 90 a, 90 brespectively couple to a four port framer 92 a, 92 b that interfaces tothe A and B FOCUS ports through a FPGA 94. Those with ordinary skill inthe art will recognize that because PPP (Point-to-Point Protocol)encapsulated packets are inserted into the SONET Payload Envelope (SPE),all POS links are concatenated, and the FPGA 94 utilized in FIG. 6E maytherefore be similar to the FPGA 86 of FIG. 6D.

Referring to FIG. 6F, there is a configuration of the network interfacesubsystem 40 of FIG. 5 for a two port OC-12c POS application. In theillustrated system, one optical interface 100 a can couple to thesubscriber, and another 100 b can couple to the internet core. The FIG.6F optical interfaces 100 a, 100 b couple to a two port-framer 102 thatinterfaces to a FPGA 104 for connection to the A and B FOCUS ports.

Referring back to FIG. 5, the illustrated Network Processor 42 alsoconnects to a CPU subsystem 110 that includes a MIPS processor 112 suchas a QED RM700A 400 MHz MIPS processor, a system controller/PCI bridge114 such as the Galileo GT64120A system controller/PC bridge, localSDRAM 116, and a Programmable Logic Device (PLD) 118. In the illustratedsystem, the PLD 118 makes accessible the board specific controlregisters and miscellaneous devices. As illustrated, the PLD 118 isconnected to a local high-speed bus on the GT64120A 114 with a localSDRAM 116, and acts as a buffer between the local high-speed bus 120 anda lower speed peripheral bus 122 that has boot PROM Flash 124 andnon-volatile RAM (NVRAM) 126 for semi-permanent storage of settings andparameters, and for providing a real-time clock for time of day anddate. The FIG. 5 PCI bus 127 connected to the PCI bridge also includestwo Fast Ethernet MACs 128 a, 128 b, such as the Intel GD82559ER 100Mbit MAC that includes an integrated PHY, to provide redundantconnections between the NPM 14 and CPM 24 via a primary and secondary100 Base-T Ethernet channel. The illustrated MACs 128 a, 128 b reside onthe PCI bus and perform Direct Memory Access (DMA) transfers between thePCI internal buffers and the defined buffer descriptors within the localMIPS memory 112. The MACs 128 a, 128 b can support an unlimited burstsize and can be limited by PCI bridge performance. In an embodiment,flow control can be utilized in a control plane application to avoidunnecessary packet loss. The illustrated GT64120A 114 allows the CPU 112and other local bus masters to access the PCI memory and/or devicebuses.

The FIG. 5 NPM 14 also includes a switch fabric subsystem 130 thatprovides high-speed, non-blocking data connections between the NPM 14and the other modules within the switch 12. The connections include twolinks to another, redundant or complementary NPM 14 and a link to eachCPM 24. The illustrated NPM's 14 portion of the fabric includes twoFocus Connect devices 132 a, 132 b, wherein one Focus Connect device 132a is connected to the IQ2000 42 port C using a FOCUS Bus, while anotherFocus Connect device 132 b is connected to port D.

In the illustrated system, the ports on the sixteen bit FOCUS bus on theFocus Connect devices 132 a, 132 b, with the exception of local porteight, are attached to a Cypress Quad Hotlink Gigabit transceiver 134that is a serial to deserial (SerDes) device 136 having dual redundantI/O capabilities and configured for dual channel bonded mode. The dualchannel bonded mode couples two channels together in a sixteen-bitchannel, wherein there can be two such sixteen-bit channels per device.Referring now FIG. 7, the dual redundant serial I/O capabilities, incooperation with a crossover on the backplane, allow any slot to beconnected to any other slot such that a packet or a data route vectormodification is not necessary when only one NPM 14 is present. The FIG.5 Serdes devices 136 convert incoming serial stream data from thebackplane, to parallel data for forwarding to the Focus Connect devices132 a, 132 b. Similarly, the Serdes 136 converts parallel data from theFocus Connect device 132 a, 132 b to serial data before placing the dataon the backplane.

For example, with the illustrated system of FIG. 4 a Focus Connectdevice 132 a, 132 b is connected to the IQ2000 FOCUS C and D ports andwherein the Focus Connect devices 132 a, 132 b maintain eight portseach, in the illustrative system wherein there is a fourteen slotchassis and there are ten slots for FPMs 22 a-22 n, two slots for NPMs14 a, 14 b, and two slots for CPMs 24 a, 24 b, the Focus Connect deviceports can be configured as shown in Tables 1 and 2: TABLE 1 FocusConnect device connected to IQ2000 FOCUS Port C (132a) Focus ConnectPort Connected Module 1 FPM, slot 1 2 FPM, slot 2 3 FPM, slot 3 4 FPM,slot 4 5 FPM, slot 5 6 CPM, slot 1 7 Other NPM, Focus Connect Port D 8Local IQ2000, Port C

TABLE 2 Focus Connect device connected to IQ2000 FOCUS Port D (132b)Focus Connect Port Connected Module 1 FPM, slot 6 2 FPM, slot 7 3 FPM,slot 8 4 FPM, slot 9 5 FPM, slot 10 6 CPM, slot 2 7 Other NPM, FocusConnect on Port C 8 Local IQ2000, Port D

As Tables 1 and 2 indicate, using the FIG. 4 NPM 14 in a redundantsystem as illustrated in FIGS. 1 and 3, the dual NPMs 14 a, 14 b canaccess all FPMs 22 a-22 n and each CPM 24 a, 24 b, and vice-versa.

The fourth major subsystem of the FIG. 5 NPM 14 is a memory subsystem140. The FIG. 5 memory subsystem is a single RAMbus channel for packetbuffer storage and flow lookup table space. In the illustratedembodiment, the memory subsystem 140 includes a search processor 142 andseveral content addressable memories 144, although those with ordinaryskill in the art will recognize that the invention herein is not limitedto the memory subsystem 140 or the components thereof.

Referring back to FIG. 5, data received by the NPM 14 can be forwardedto the IQ2000 42 that can include instructions for recognizing packetsor data flows. For example, CPU or processor instructions can implementor otherwise utilize a hash table to identify services or processing foran identified packet or flow, wherein the packet or flow cansubsequently be forwarded to a FPM 22, for example, in accordance withthe service or processing. Alternately, unidentified packets can beforwarded to the MIPS 112 that can include instructions for identifyingthe packet or flow and associated processing or services. In anembodiment, packets unable to be identified by the MIPS 112 can beforwarded by the MIPS 112 to the CPM 24 that can also includeinstructions for identifying packets or flows. Identificationinformation from either the CPM 24 or MIPS 112 can be returned to theIQ2000 42 and the hash table can be updated accordingly with theidentification information.

Referring now to FIG. 8, there is a basic schematic block diagram of aFPM 22 for the system illustrated in FIGS. 1-3. In the embodiment ofFIG. 8, the FPM 22 is based upon Intel's 440BX AGPset, with a majorityof the FPM functionality similar to a personal computer (PC). Theillustrated FPM 22 can therefore be viewed as having four main sectionsthat include a processor or CPU 120, a 440BX AGPset 122, a FOCUSinterface, and peripherals. In the illustrated system of FIGS. 2 and 4,the FPMs 22 are identically designed, although those with ordinary skillin the art will recognize that the methods and systems disclosed hereinmay include differing FPM designs.

Referring to FIG. 8, the illustrated FPM 22 embodiment supports a singlesocket 370 Intel Pentium III CPU 150 with a 100 Megahertz processorsystem bus (PSB), although such processor is merely for illustration andnot limitation, and those with ordinary skill in the art will recognizethat the invention disclosed herein is not limited by the CPU selectionor processor component. Similarly, those with ordinary skill in the artwill recognize that multiple processors 150 can be incorporated withinthe FPM architecture without departing from the scope of the invention.The representative FPM 22 also includes a 440BX Accelerated GraphicsPort (AGPset) 152 that provides host/processor support for the CPU 150.

Data packets moving into and out of the FPM 22 in the illustrated systemuse a 16-bit wide 100 Megahertz bus called the FOCUS bus, and in theillustrated embodiment, a full-duplex FOCUS bus attaches to every FPM 22from each NPM 14, wherein in the illustrated embodiment of dualredundant NPMs 14 a, 14 b, every FPM 22 communicates with two NPMs 14 a,14 b. As indicated previously, the FOCUS bus signal is serialized on theNPM 14 a, 14 b before it is placed on the backplane, to improve signalintegrity and reduce the number of traces. As illustrated, deserializers154 a, 154 b on the FPM 22 convert the signal from the backplane to abus and the bus connects the deserializers 154 a, 154 b to a FocusConnect 156 that interfaces through a FPGA 158 and Input OutputProcessor 160 to the 440BX AGPset 152. The illustrated PRC is aneight-way FOCUS switch that allows the FPM 22 to properly direct packetsto the correct NPM 14.

The FIG. 8 FPM 22 also maintains peripherals including control planeinterfaces, mass storage devices, and serial interfaces. In theillustrated FPM 22, the control plane provides a dedicated path forcommunicating with the FPM 22 through two fast Ethernet controllers 130a, 130 b that interface the AGP 152 to the redundant control plane. Asindicated in FIGS. 2 and 4, it is typically the CPM 24 a, 24 b thatcommunicates with the FPM 22 via the control plane. In the illustratedembodiment, the fast Ethernet controllers 130 a, 130 b connect tocontrol planes that are switched 100 Megabits/second Ethernet networksthat terminate at the two CPMs 24.

The illustrated FPM 22 may also support different types of mass storagedevices that can include, for example, a M-Systems DiskOnChip (DOC), a2.5 inch disk drive, NVRAM for semi-permanent storage of settings andparameters, etc.

Referring now to FIG. 9, there is an illustration of a sample CPM 24 aspresented in the systems of FIGS. 2 and 4. As indicated previously, theCPM 24 performs generic, switch-wide functions and is connected to theother switch components through a data interface that, in theillustrated embodiment, is identical to the data interface of FIG. 7 forthe FPM 22. Those with ordinary skill in the art will recognize that thecommon data interfaces for the FPM 22 and CPM 24 modules are merely forconvenience and do not limit the scope of the invention.

As discussed earlier, in the illustrated embodiment, the control planesterminate at a CPM 24, wherein the illustrative control planes are dualredundant, private, switched 100 Megabit Ethernet. The switchingelements are housed on the CPM 24, and therefore all point-to-pointconnections between other modules and a CPM 24 are maintained throughthe backplane connector.

Additionally, the CPM 24 controls the switch 12 boot process and managesthe removal and insertion of modules into the switch 12 while the switch12 is operational.

In the illustrated CPM 24 of FIG. 9, the main CPU 170 is a Pentium IIIprocessor, although the invention herein is not so limited, and anyprocessor or CPU or device capable of performing the functions describedherein may be substituted without departing from the scope of theinvention, wherein multiple processors or CPUs may additionally beutilized. In the illustrated CPM 24, a 440BX Accelerated Graphics Port(AGPset) 172 provides host/processor support for the CPU 170. The FIG. 9AGP 172 supports a PCI interface to connect to miscellaneous hardwaredevices.

Three fast Ethernet controllers 174 a, 174 b, 174 c also reside on thePCI bus of the 440 BX 172. One of these three fast Ethernet controllers174 a provides external communications and multiplexes with the fastEthernet on the other CPM 24. The other two fast Ethernet controllers174 b, 174 c provide dedicated communications paths to the NPMs 14 andFPMs 22. In the illustrated system of FIG. 9, the fast Ethernetcontroller is an Intel 82559ER, fully integrated 10BASE-T/100BASE-TX LANsolution combining the MAC and PHY into a single component, althoughsuch embodiment is merely provided as an illustration. In theillustrated system, the fast Ethernet controllers 174 b, 174 c interfaceto an Ethernet switch 176 that provides fourteen dedicated communicationpaths to the control plane for up to ten FPMs 22 and two NPMs 14.

Data packets move into and out of the illustrated CPM 24 using asixteen-bit wide 100 MHz FOCUS bus. In the illustrated system, there isone full-duplex FOCUS bus coupling each CPM 24 to each NPM 14, whereinfor the illustrated system of FIGS. 2 and 4 having dual redundant NPMs14 a, 14 b, each CPM 24 couples to two NPMs 14 a, 14 b. Serdes devices178 a, 178 b convert incoming serial stream data from the backplane, toparallel data for forwarding to a Focus Connect device 180. Similarly,the Serdes 178 a, 178 b convert parallel data from the Focus Connect 180to serial data before placing it on the backplane. The illustrated FocusConnect 180 is a switch used by the CPM 24 to direct packets to thecorrect NPM 14. In the FIG. 9 system, packets are moved into and out ofthe CPU memory 182 through a FPGA 184 and Input Output Processor 186that interface the Focus Connect 180 to the AGP 172.

Referring again to the systems of FIGS. 2 and 4, the CPMs 24 coordinatethe different components of the switch, including the NPMs and FPMs, andsimilarly support access to a local storage device 30 that can also bereferred to as a local memory device. In one embodiment, the localstorage device 30 can store images, configuration files, and databasesfor executing applications on the FPMs 22. For example, the local device30 may store subscriber profiles that can be retrieved for use by eitherthe NPM 14 or FPMs 22. In an embodiment, a configuration file for aparticular application or subscriber can be retrieved and copied tomultiple FPMs 22, for example, thereby providing increased efficiency ina scenario wherein multiple, identically configured FPMs 22 are desired.In such an embodiment, FPMs 22 may be grouped for a subscriber. Thelocal storage device 30 can be any well-known memory component that maybe removable or resident on the CPMs 24, including but not limited to afloppy disk, compact disc (CD), digital video device (DVD), etc. In theillustrated system, there is at least one local storage device for eachCPM 24. Similarly, in the illustrated system, the local storage device30 can be divided into several partitions to accommodate and protectcertain processor's needs, including the processors on the various FPMs22. In one embodiment, the local storage device 30 can include twoidentical disk partitions that allow dynamic software upgrades. In anembodiment, two disk partitions can include identical groups ofpartitions that can include swap partitions, common partitions for useby all processors, and specific partitions for different moduleprocessors (i.e., NPMs, FPMs, CPMs).

The illustrated CPMs 24 can also access a remote storage device 32,wherein such remote storage can store services, database, etc., that maynot be efficiently stored in the local memory device 30. The remotestorage device 32 can be any compilation of memory components that canbe physically or logically partitioned depending upon the application,and those with ordinary skill in the art will recognize that theinvention herein is not limited by the actual memory components utilizedto create the remote storage device 32.

The FIG. 2 CPMs 24 also couple to at least one management server (MS)module 28. In the illustrated embodiment, the connection is a 100Base-TEthernet connection. In the FIG. 2 system, the MS 28 can receive andaggregate health and status information from the switch modules 14, 22,24, wherein the health and status information may be provided to the MS28 through the CPMs 24. In an embodiment wherein NPMs 14, FPMs 22, andCPMs 24 are redundantly provided, for example, the MS 28 can activate orinactivate a particular apparatus 12 module. In the illustratedembodiments, the MS 28 communicates with the apparatus 12 modulesthrough the CPM 24. In an embodiment, the MS 28 may be a PC, SunWorkstation, or other similarly operational microprocessor controlleddevice, that can be equipped with microprocessor executable instructionsfor monitoring and controlling the apparatus 12 modules. In anembodiment, the MS 38 can include an executable that provides agraphical user interface (GUI) for display of apparatus 12 monitoringand control information. In one embodiment, the MS 38 can be a separatedevice from the CPM 24, while in another embodiment, the MS 28functionality can be incorporated into the CPM 24, for example, byutilizing a separate processor on the CPM 24 for MS 38 functionality.

In an embodiment, the well-known Linux operating system can be installedon the FPM 22 and CPM 24 processors, thereby providing an openarchitecture that allows installation and modification of, for example,applications residing on the FPMs 22. In the illustrated systems, themanagement and control of applications on the switch modules can beperformed using the MS 28. In the illustrated embodiments, the MS 28management can be performed using the CPM 24. Applications such asfirewall applications, etc., in the illustrated embodiments cantherefore be downloaded, removed, modified, transferred between FPMs 22,etc. using the MS 28.

In an embodiment, the NPMs 14 can execute the well-known Vxworksoperating system on the MIPS processor and a small executable on theIQ2000 processor 42. Those with ordinary skill in the art will recognizethat the methods and systems disclosed herein are not limited to thechoice of operating systems on the various switch modules, and that anyoperating system allowing an open architecture can be substituted whileremaining within the scope of the invention.

One advantage of the present invention over the prior art is that aswitch architecture is disclosed with multiple processor modules havingan open architecture wherein applications may be distributed to andthroughout the multiple processors for efficient servicing byapplications throughout a network, and wherein a distinct processormodule can interface to the network and appropriately direct data fromthe network, to one of the multiple processor modules in part as afunction of the multiple processor processing loads, and hence returnthe processed data to the network.

What has thus been described are an apparatus and method to distributeapplications and services in and throughout a network. The apparatusincludes the functionality of a switch with the ability to applyapplications and services to received data according to respectivesubscriber profiles. Front-end processors, or Network Processor Modules(NPMs), receive and recognize data flows from subscribers, extractprofile information for the respective subscribers, utilize flowscheduling techniques to forward the data to applications processors, orFlow Processor Modules (FPMs). The FPMs utilize resident applications toprocess data received from the NPMs. A Control Processor Module (CPM)facilitates applications processing and maintains connections to theNPMs, FPMs, local and remote storage devices, and a Management Server(MS) module that can monitor the health and maintenance of the variousmodules. In an embodiment, the MS can download and otherwise controlapplications on the FPMs that execute the Linux operating system toprovide an open architecture for downloading, executing, modifying, andotherwise managing applications.

Although the present invention has been described relative to a specificembodiment thereof, it is not so limited. Obviously many modificationsand variations of the present invention may become apparent in light ofthe above teachings. For example, although the illustrated systemsdivided the modules into various components, the functionality ofcomponents may be combined into a single module where appropriate,without affecting the invention. For example, the management servermodule may be incorporated in the control processor module.Additionally, the processors and supporting components of the differentmodules may be replaced with other, similarly functioning components. Insome embodiments, additional supporting components may be desired, whilein other embodiments, some of the illustrated supporting components canbe omitted. The connections between components, although in theillustrated embodiments include Ethernet connections, may include wiredor wireless Ethernet, for example, or may include any combination ofcommunicative channel and protocol, wherein examples of wired orwireless communicative channels may be bus configurations, cabling,infrared, spread spectrum, or other communicative channels orconnections, and examples of protocols may include pseudo noisemodulation, Frame Relay, Asynchronous Transfer Mode (ATM), etc., whereinsuch combinations of communicative-channel and protocol may herein bedescribed and defined as electrical connections. Although theillustrated systems utilized Gigabit Ethernet connections, 100Base T,etc., any other high-speed data link can be substituted therein withoutdeparting from the scope of the invention.

Many additional changes in the details, materials, steps and arrangementof parts, herein described and illustrated to explain the nature of theinvention, may be made by those skilled in the art within the principleand scope of the invention. Accordingly, it will be understood that theinvention is not to be limited to the embodiments disclosed herein, maybe practiced otherwise than specifically described, and is to beunderstood from the following claims, that are to be interpreted asbroadly as allowed under the law.

1. A network apparatus, comprising, at least one flow processor modulehaving at least one processor and at least one memory for storingapplications for execution by the at least one processor, at least onenetwork processor module having at least one processor, at least oneinterface to receive data from and transmit data to the network, andinstructions to cause the at least one processor to recognize a datarequest for processing by the applications in the flow processor modulememories, and to forward the data request to a flow processor modulecapable of processing the data according to the data request, and, atleast one control processor module in communication with the flowprocessor modules and the network processor modules, and having at leastone processor, and instructions for causing the at least one processorto manage the applications in the flow processor module memories.
 2. Anetwork apparatus according to claim 1, wherein the control processormodule instructions for causing the at least one processor to manage theapplications in the flow processor module memories further includeinstructions to cause the control processor module to perform at leastone of, downloading applications to the flow processor module memories,and deleting applications from the flow processor module memories.
 3. Anetwork apparatus according to claim 1, further comprising a managementserver module in communication with the control processor module andhaving at least one processor.
 4. A network apparatus according to claim3, wherein the management server module further includes instructionsfor causing the at least one management server processor to cause thecontrol processor module to perform at least one of, downloadingapplications from the management server module to the flow processormodule memories, and deleting applications from the flow processormodule memories.
 5. A network apparatus according to claim 1, furthercomprising a local memory device coupled to the control processormodule.
 6. A network apparatus according to claim 1, further comprisinga remote memory device coupled to the control processor module.
 7. Anetwork apparatus according to claim 1, wherein the control processormodule further includes instructions to cause the at least one controlprocessor module processor to transfer data between a management servermodule and the flow processor modules.
 8. A network apparatus accordingto claim 1, further comprising at least one storage device coupled tothe at least one flow processor module.
 9. A network apparatus accordingto claim 1, further comprising at least one storage device coupled tothe at least one network processor module.
 10. A network apparatus,comprising, at least one flow processor module, having, at least oneprocessor, and at least one memory to store applications for executionby the at least one processor, and, a first network processor modulehaving at least one processor, at least one interface to receive datafrom and transmit data to the network, and instructions to cause the atleast one processor to recognize a data request for processing by theapplications in the flow processor module memories, and to forward thedata request to a flow processor module capable of processing the dataaccording to the data request, and, a first control processor module incommunication with the first network processor module and the flowprocessor modules, and having, at least one processor, and, instructionsfor causing the at least one processor to manage the applications in theflow processor module memories.
 11. A network apparatus according toclaim 10, further comprising, a management server module incommunication with the control processor module, and having at least oneprocessor with instructions to manage the applications on the flowprocessor modules.
 12. A network apparatus according to claim 10,further comprising a first control plane to couple the first networkprocessor module, the flow processor modules, and the first controlprocessor module.
 13. A network apparatus according to claim 10, furthercomprising a distinct second control plane to couple the first networkprocessor module, the flow processor modules, and the first controlprocessor module.
 14. A network apparatus according to claim 13, furthercomprising, a distinct second network processor module coupled to thefirst control plane and the second control plane, and having at leastone processor, at least one interface to receive data from and transmitdata to the network, and instructions to cause the processor torecognize a data request for processing by the applications in the flowprocessor module memories, and to forward the data request to a flowprocessor module capable of processing the data according to the datarequest, a distinct second control processor module coupled to the firstcontrol plane, the distinct second control plane, and the managementserver module, and having at least one processor.
 15. A networkapparatus according to claim 10, further comprising a local memorydevice that is coupled to the first control processor module.
 16. Anetwork apparatus according to claim 14, further comprising a localmemory device that is coupled to the first control processor module andthe second control processor module.
 17. A network apparatus accordingto claim 10, further comprising a remote memory device that is coupledto the first control processor module.
 18. A network apparatus accordingto claim 17, further comprising a high speed data link to couple theremote memory device to the first control processor module.
 19. Anetwork apparatus according to claim 14, further comprising a remotememory device that is coupled to the first control processor module andthe second control processor module.
 20. A network apparatus accordingto claim 19, further comprising a high speed data link to couple theremote memory device to the first control processor module and thesecond control processor module.
 21. A network apparatus according toclaim 11, further comprising a high speed data link to couple themanagement server module to the first control processor module.
 22. Anetwork apparatus according to claim 14, further comprising, amanagement server module in communication with the control processormodule, and having a processor with instructions to manage theapplications on the flow processor modules, and, a high speed data linkto couple the management server module to the first control processormodule and the second control processor module.
 23. A network apparatusaccording to claim 11, wherein the management server module furthercomprises a processor and instructions for causing the processor totransmit and receive data from the first control processor module.
 24. Anetwork apparatus according to claim 11, wherein the management servermodule is a personal computer.
 25. A network apparatus according toclaim 11, wherein the management server module further includesinstructions to receive health and maintenance data from the firstnetwork processor module, the flow processor modules, and the firstcontrol processor module.
 26. A method for distributing applications ina network, comprising, receiving data from the network at a networkdevice, identifying at least one application to apply to the data,processing the data according to the identified applications, and,forwarding the processed data from the network device.
 27. A methodaccording to claim 26, further comprising applying policy to the data.28. A method according to claim 26, wherein identifying at least oneapplication further comprises utilizing a hash table to associate thedata to at least one application.
 29. A method according to claim 26,wherein identifying at least one application further comprises,associating a subscriber profile with the data, and, selecting at leastone application based on the subscriber profile.
 30. A method accordingto claim 26, wherein processing the data according to the identifiedapplications further comprises directing the data to at least oneprocessor for executing the identified applications.
 31. A methodaccording to claim 30, further including configuring the processors forthe identified applications.
 32. A method according to claim 26, furtherincluding selecting at least one processor based on the applications.33. A method according to claim 26, further including selecting at leastone processor based on processor loading.
 34. A method according toclaim 26, further including selecting at least one processor based onapplying a policy to the data.
 35. A method according to claim 26,wherein identifying at least one application to apply to the datafurther comprises, identifying the data source, and, retrieving anapplication profile based on the data source.
 36. A method according toclaim 26, wherein forwarding the processed data from the network devicefurther includes, forwarding the processed data to the network.
 37. Amethod according to claim 26, wherein forwarding the processed data fromthe network device includes forwarding the processed data to a storagedevice.
 38. A method according to claim 26, further includingdetermining a destination to forward the processed data.
 39. A methodaccording to claim 26, further comprising providing applications toprocessors at the network device.
 40. A method according to claim 39,wherein providing applications to processors at the network devicefurther includes downloading applications to processors from at leastone of a remote processor and storage device.
 41. A method for managingapplications on a network apparatus, comprising, providing at least oneflow processor module having at least one processor and at least onememory for storing applications, providing at least one networkprocessor module connected to the flow processor module, having at leastone processor and instructions for, recognizing a data request forprocessing by the applications on the flow processor modules, and,transferring data requests to flow processor modules capable ofprocessing the data request, and, connecting a control processor moduleto the flow processor module and the network processor, the controlprocessor module in communication with the flow processor module and thenetwork processor module, and having at least one processor andinstructions for causing the processor to perform at leas one of,deleting applications from the flow processor modules, and, storingapplications to the flow processor modules.
 42. A method according toclaim 41, further comprising, providing a management server module incommunications with the control processor module, the management servermodule having a processor and instructions for controlling theapplications on the flow processor modules.
 43. A method according toclaim 41, wherein providing at least one network processor modulefurther includes providing processor instructions for, receiving datafrom the network, processing data from the network, receiving processeddata from the flow processor modules, and, transferring the processeddata to a network destination.
 44. A method according to claim 41,providing at least one network processor module further includesproviding processor instructions for forwarding received data to anetwork destination.
 45. A method according to claim 41, whereinconnecting a control processor module further includes providinginstructions for causing the processor to perform processing of datarequests from the network processor module.